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Comparative Reliability of Two Measures of Family Functioning 

, ABSTRACT - ^ 

. « ■ * • . j 

i 

The Family Environment Scale XFES) And the Family 
Adaptability and Cohesion Evaluation Scales <FACES~II> were gi-ven 
to separate halves of a triethnic sample of adult family members 
at two times, separated by a week. FACES II was given to all the 
children two times, separated by a week. Item analyses, internal 
consistency and test retest reliability coefficients, and factor 
analyses were conducted on the scales. The cohesion, conflict and 
recreation scales o* the FES were shown to have more acceptable 
psychometric characteristics than the FACES II. The test-retest 
reliability scores were higher than the internal consistency 
coefficients, indicating that the instruments were detecting 
reliable variance, but these were not sensitively reflected in the 
preidentif ied scales. Internal consistence and test-retest 
reliability coefficients varied by ethnicity. It appears the FES\, 
is the instrument of choice in the studied populations. 
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A person's family has been shown to be an important influence 
on health brnavior (Baranowski & Nader, i?B5a) and health behavior 
changes (Baranowski «< Nader, 19B5b> . Aspects of family 
functioning have been shown to be more related to health behaviors 
than have aspects of family structure (Baranowski & Nader, 19B5 a 
& b ) . 

While many aspects of family functioning have been measured, 
Moos and Moos (19B1) developed a multivariate inventory (Family 
Environment Scales - FES) assessing- ten aspects of family 
functioning. . Olson, Sprenkle & Russell (1979) argued that the two 
predominant dimensions of family functioning are cohesion and 
adaptability. Olson, Bell & Portner, (1978) developed measures of 
these two constructs (Family Adaptability and Cohesion Evaluation 
Scales - FACES) . Fowler (1981, 1982) argued that a second order 
factor analysis of the Moos items revealed the same two family 
dimensions propsed by Olson. 

Given the importance of these concepts, Valid and reliable 
measures are needed. Moos and Moos (1981) reported modest 
internal consistent values (0.61 to 0. 78) and two month 

* 

test-retest reliability values (0.68 to 0.86) across the ten 
scales with their initial development sample. This sample 
reportedly included families of many characteristics, but internal 
consistency data were not reported within all subgroups. Few 
other studies have reported the psychometric characteristics of 
the FES. 

Olson's instrument has received more critical attention. The 
first version of the FACES (Olson, Bell 8< Portner, 1978) 
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demonstrated acceptable internal consistency values. Three 
subsequent reports (Alexander, Johnson & Carter, 1984, Bilbro & 
Dreyer, 1981, Stallworth, 198,2) , however , pointed out 0 conceptual 
and methodological problems,, questioning the validity of FACES I. 
Olson, McCubbin and associates (1983) developed a shorter version 
•for which they reported acceptable internal consistency (0.87 ior 
cohesion, 0.78 -for adaptability) and test-retest reliabilty (0.83 
for cohesion, 0.80 for adaptability). No further psychometric 
characteristics of th<3 FACES II have appeared in the literature. 
Olson and codeveloper's have not responded to the critique about 
the multifactorial nature of their two constructs <Alexander et 
cti, 1984, Bilbro & Dreyer, 1981). 

Acceptable' reliability needs to be domonstrated for any new 
population with which an instrument may be employed. This paper 
reports on the psychometric characteristics of both the Moos FES 
and the Olson FACES II in a group of adults and children from 
three ethnicities in Galveston, TX. 

METHODS 

.Design.. Datea were collected as part of a larger study on 
the validity and reliability of self report measures of diet and 
exercise. Within ethnic groups the adults were randomly assigned 
by family to complete the FES or the FACES II. Because of its 
simpler language and fewer (thirty) item? all children were 
assigned FACES II. The instruments were initially administered at 
an afternoon session at which the families were trained to obtain 
diet, exercise and urine meassures on a daily basis. The same 
instruments were readmini stered one week later when the family 
came to a morning clinic for assessment of blood pressure, body 
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composition and physical fitness. The instruments were 
administered in groups of one to four families at a time. 

-SaoiBlgA. Families were recruited for this study if adults ° 
and children lived in the same household, had a. child in the thirif 
to sixth grades, were one of three ethnicities (Anglo-, Black-, or 
Mexican-American) and were healthy (i.e. no participating family 
member had- a chronic illness). All the families were volunteers. 
The methods- for family recruitment of this sample have been 
reported elsewhere (Hooks, Baranowski , vanderpool & Nader, 1985) . 

-iDsfeCLiineafeSi Form R of the FEB was /tempi oyed in its original 
(Moos and Moos, 1981). The FACES II was employed' in its original 
format as well (Olson, McCubbin and Associates, 1983). For the 1 

Q V 

adults, almost all cases were. self administered. If an adult was 
having difficulty, the items were read and interpreted as 
necessary. Among children, the -person conducting the initial 
training session usually assisted by reading the items and 
interpreting words which were not clear. 

A.Qa.Iy.§e.Si Item analyses with assessment of internal 

consistency (Cronbach's alpha) and test-retest reliability (the 
' unbiased estimator from the stric'tly parallel model in SFSS) were 
conducted for adul-ts and chi 1 dren- separately and for each grade 
within each instrument for the two administrations, separately. 
For adults, and children separately a principal components analysis 
with varimax and oblique rotations were conducted. 

If tht.» scales in these instruments are reliable, we would 
expect to obtain the followings sc. le specific item-total 
correlations of 0.15 (preferably 0.20) or higher, with no negative 
item-total correlations; scale specific internal consistency 
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measures of 0.80 or higher with none below 0.70* test -retest 
reliaility (T-RT) values to be somewhat lower (but approximately 

0 

0.80) than the internal consistency measures since :he interval of 
a week between assessments would permit some re. « > je to occur 
which would lower the true reliability from a measure of internal 
consistency. For che factor " analyses we would expect that -the 
same number of factors would be produced in 'our analyses, and the 
newly obtained factors would closely replicate the instrument's 
oriqinal set of items included in each factor. (In regard to the 
Moos FES, since we had a small sample, we decided to conduct five 
separate factor analyses each of which included the items from two 
of the . scales in the original FEB. In this way, our sample was 
adequate for the number of items included in the 4 anal ysi s , and 
only two factors should result per analysis.) 

. RESULTS 

' .Sample^gharacteristicSi Data were obtained on 111 families. 
Acceptable family functioning data were obtained on 131 adults and 
87 children. Distributions of participants across age, ethnicity, 
gender, and grade characteristics are found in Table 1. - 

***** TABLE 1 about here ***** 
_Item_Anal_yses - FACES_II.v An uneven pattern resulted for 
the internal consistency and test-retest (T-RT) reliabilities for 
the cohesion and adaptability scales at the pre and post 
assessments for the whole sample and for specific subsamples (see 
Tables 2 and 3). In general, neither the cohesion nor the 
adaptability scales consistently exceeded the desired value of 
0.80. Of greater note is that the T-RT values are consistently 
higher than the internal consistency measures. In general, the 
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adult© have higher alpha and T-RT values than the children; female 
adults" have higher values than m, .lesj and sixth graders have 
higher values, than 3rd, 4th, or 5th graders. The item-total 
corr/elations -from these analyses reveal.ed several negative 



it.^m-total corr 



•from these anarityaef 
el ati ons. f ( . 



* ***** TABLES 2 and 3 about here ***** , % ~ 

-Factor Analyses - FACES^II.. A -factor analysis was 

conducted on the^ FACES II items across all adult participants. 
The varimax and oblique rotations produced similar -factors, so the 
varimax rotated factors are described here. Ten factors were 
obtained with an eigenvalue of 1.0 or higher. 4 The items loading 
0.4 or higher did not reveal a consistent pattern of separate 
cohesion and adaptability factors or subf actors. For example the 
first factor had s. ^en iWms, four from the cohesiveness scale and 
three from the adaptability scale. Eight of the 30 items loaded 
high on two or more factors using the varimax rotation. Fifteen 
of 30 items loaded high on two or more factors using the oblique 
rotation. These factors in no way corresponded to the scales 

j 

derived by Olson and colleagues. 

There is reason to believe that a factor analysis should be 
constrained to the number of factors defining the items inserted 
into the factor analysis (Walkey, 1983). When constrained tb two 
factors, the factors revealed the same, apparently random 
combination of items from the original cohesiveness and 
adaptability scales. There was $ an insufficient sample to conduct 
separate factor analyses within ethnic or gender subsamples of 
this study. 

_Item Analyses -- FES. The reliability analyses lor the 
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Moos * Family Environment Scales <FES> provided a pattern of results 

9 u 

«. that varies by scale (see TAB^E 4). The two scales of greatest 
interest for research on families and health behavior change are 
cohesiveness and conflict. The values on these scales come closer 
to the acceptable ranges than values on the other scales, or the 
original values op the FACES II. It is disconcerting that ±he 
test-retest reliability scores are consistently higher than the 

\ 

0 « 

internal consistency scores. The-walues for the Blacks on these 
two scales are not as high as those for the Anglos, but 
consistently higher than those for the Mexican-Americans. 

*****TABLE 4 about here***** 

_Fa£tor Analysis - FES.. In all cases factor analysis 

revealed more factors than the two characterizing the items 
inserted in the analysis. In virtually every case, however, the 
empirically obtained factors identified subsets of items in one or 
the other of the original two scales inserted, or the items from 

- one scale were negatively loaded on a factor with positively 
loaded items from the other scale. ' A large number of items in 
each analysis did not load on either factor. Since all items were 
, .t factor analysed si mul taneousl y , it is not clear what other 

• factors might appear from correlations among items not included in 

* 

i 

thfc same factor analysis. 

DISCUSSION 

• ' Neither instrument demonstrated all the desired psychometric- 

properties. The internal consistency values were lower than those 
reported by Moos and Moos <1981) or Olson et al (1978). This low 

internal consistency indicates that each scala is either measuring 
• -• - ^ 

multiple constructs, or the one construct poorly. The 
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consistently higher test-retest correlations than the internal 
consistency values als6 indicates that the items are consistently 
measuring some phenomena, but not the supposedly unidi mensional 
cdn struct in each' scale. The factor analyses reveal the items are 

measuring multiple constructs, other than those proposed in the 

** . * 

original scales. In the case^of FACES II, these new dimensi-ens 

r 

correspond in no way to the original dimensions. In .the case of 
FEB, the dimensions identify subscales of the original dimensions. 
It is not. clear, .therefore, what FACES II is measuring in this 
population. Si mi far to the comments of Bilbro and Dreyer (1981) 
and Alexander et al (1984) in their assessment of FACES I, the 
multiule subscales in the FACES II pose conceptual and empirical 
problems. Does it make sense to combine these sevfffal subscales" 
into a unified measure? .Although Olson reported combining items 

"** ♦ 

from several scales to create the cohesion scale, there is no 
evidence that Moos and Moos did this- * Perhaps one or another of 
the FES subscales will more likely predict other events than the 
comprehensive scale and therefore' may o . be more useful than the 
r.cm^rehensi vu scale in understanding health related behaviors. 
Further conceptual and psychometric research may be necessary to 
clarify the concepts to which these subscales correspond. 

Another disconcerting aspect of these data is the 
inconsistency in the internal consistency values across ethnic 
groups. Typically (but not always) the iternal consistency values 

were highest among Anglos. We cannot say why this occurred. 

■f 

Three possibilities come to mind. Perhaps the minority group 
members have more difficulty answering these kinds of items 
because of differences in language, reading ability, or lack of 
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"familiarity with these kinds of scales? Perhaps minority group 
members require different items which specify -more culturally 
relevant behaviors f to specify the same conceptual domain? Or, 
perhaps •• these aspects of family functioning do not measure 
meaningful aspects of minority group famil/ life? In a personal 
communication, Olson reported that, the FACES II was created for 
use' with two parent nuclear* families and • it would not be 

r 

appropriate for use with othfer family structures. This may 
account for the lower reliability in the Black-American families. 
More work .must obviously be done to develop scales appropriate to 
'meaningful 'aspects of minority group family functioning. 

In conclusion, investigators^ interested in the cohesion, 
conflict .or . active-recreational dimensions of family funutioning 
among minority populations at this time should employ the Moos and 
Moos instrument. These scales have reasonably acceptable 
psychometric properties in most of the subgroups anal'yaed. 

Investigators interested .in dlher' aspects of family functioning 

'v. 

need t<5^compare the internal consistency of several measures of 
family functioning in the populatons of interest to them, and 
select that measure with the most acceptable ' psychometric 
characteristics- ' 
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TABLE 1. Ethnicity, gender and grade characteristics -for adults and 
children completing the Family Environment Scales (FES) and 
Family Adaptability and Cohesion Evaluation Scales (FACES II) 



FES . FACES II 



TOTAL 




ADULTS 


ADULTS 


CHILDREN 




69 


62 


87 


ETHNICITY . 


ANGLO 


18 


17 


20 




BLACK 


38 


36 


53 




MEXICAN 


13 


9 


14 


GENDER 


MALE 


22 


22 . 


38 




FEMALE 


47 


40 


49 


GRADE 


THIRD 






24 




FOURTH 






24 




FIFTH 






23 




SIXTH 






16 
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TABLE 2. Internal consistency and test-retest reliability of 
FACES II scales -for several subsamples of adults 







COHESION 






ADAPTABILITY 


* 






(16 


ITEMS) 






(14 


ITEMS) 






JM 


PRE 


POST 


T-R 


N 


PRE 


POST 


T-R 


TOTAL 


62 


.643 


.680 


.727 


62 


.714 


. 723 


.783 


ANGLO 


17 


.759 


.764 


.838 


17 


.643 


.625 


.748 


BLACK 


36 


.556 


.619 


.653 


36 


.572 


. 667 


.698 


MEXICAN 


9 


. 607 


.714 




9 


. 874 


.855 


.923 


MALE 


22 


. 500 


. 593 


.683 


22 


.415 


.654 


.694 


FEMALE 


40 


.699 


.721 


. 765 


40 


.787 


.754 


.825 
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TABLE 3. Internal consistency 
FACES II scales for 

COHESION 
(16 ITEMS) 





N— 


PRE 


POST 


TOTAL 


87 


.462 


.486 


ANGLO 


20 


.495 


.568 


BLACK 


53 


.479 


.462 


MEXICAN 


14 - 


. 172 




MALE 


38 


.504 


. 408 


FEMALE 


49 

4 


.423 


.544 


GRADE 3 


-24 


.279 


. 157 


GRADE 4 


24 


.468 


-627 


GRADE 5 


23 


■ 356 


.394 


GRADE 6 


16 


.616 


.666 



J 
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and test-retest reliability of 
several subsamples cvf children. 

ADAPTABILITY 
(14 ITEMS) 



T-R 


N 


PRE-. 


. P'JST 


T-R 


.626 


87 


. 430 


.494 


.675 


.724 


20 


.685 


.782 


.874 


.642 


53 


. 054 


. 191 


m 392 


.440 


14 


. 6r/.o 


. 636 


.825 


.634 


38 


. 555 


.702 


. 800 


.644 


49 


.301. 


. 139 


.490 


.466 


24 


m 369 


.412 


.669 


.728 


24 


.219 


.591 


.675 


.527 


23 


.484 


.304 


. 63 1 


.797 


.16 


.676 


.735 


.839 
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TABLE 4 i FES SCALES - Measures c* Reliabiltiy. 

OQQi.SCALgS 



COHESION 
. PRE POST T-RT 



EXPRESSIVENESS 
PRE POST T-RT 



CONFLICT 
PRE POST T-RT 



CATEGORIES 
OF SAMPLE 



CATEGORIES 
OF SAMPLE 



N 





TOTAL 


69 


.71 


.75 


.82 


-.05 


. 3s 


.52 


.65 


.73 


.82 




MALES 
FEMALES 


22 
47 


.58 
.75 


.75 
.75 


. .71 
.86 


-.71 
. 10 


.51 
. 18 


.42 * 
.38 


.59 
.69 


.71 
. 75 


.82 
.82 




ANGLOS 

BLACKS 
MEXICANS 


IS 
38 
13 


.87 
.68 
.49 


.90 
.66 
. 47 


.91 
.79 

.75 . 


.41 
-.49 
-. 12 


.76 
.32 
-1.60 


. 70 
.34 ; 
- . 00 


.78 
" .65 
. 33 


.82 
.68 
.67 


.90 
.77 
.74 



CATEGORIES 
OF SAMPLE 



INDEPENDENCE' 
PRE POST T-RT 



ACHIEVEMENT 
PRE POST T-RT 



INTELLECTUAL 
PRE PtyST T-RT 



\ 



TOTAL 


.42 


.65 


.59 


.52 


.69 


.60 - 


.55 


.65 


.71 


MALES . 
FEMALES 


.29 
.45 


.73 
.57 


.62 
. 60 


.4,7 
.56 


.77 
.63 


.67 
.58 


■ 36 
.61 


.66 


.65 

\- 7S 


ANGLOS 
BLACKS 
MEXICANS 


.68 
.24 
.34 


.88 
.47 
■ 38 


.81 
.42 
. 64 


.69 
.52 

^'4 


.78 
.61 
-.34 


.76 
.48 
.41 


.71 
.46 

.55 


.81 
.49 
.64 


.83 

.65 * ' 
.77 ... 



ACTIVE- 
RECREATIONAL 
P P T 
R O 

E S R 
T T 



MORAL 
RELIGIOUS 
PPT 
R 0 - 
E S R 
T T 



ORGANIZATION 
PPT 
R 0 
E S R 
T T 



CONTROL 
PPT 
R 0 
E S R 
T T 



TOTAL 


■ 63 


.70 


. 78 


■ 55 


.81 


.76 


.58 


. 73 


MALES 


.49 


.74 


.81 


.63 


.84 


.83 


. '30 


. 80 


FEMALES . 


.68 


.67 


. 79 


.48 


.78 


.71 


.62 


.68 


ANGLOS 


.77 


.82 


.87 


.65 


.88 


.84 


.71 


.84 


BLACKS 


.46 


.65 


.72 


.52 


.83 


m fO 


.51 


.66 


MEXICANS 


.69 


.52 


.83 


. 69 


.57 


.81 


.54 


.71 



.79 

• 83 
.78 

.86 
.74 
.84 



41 

35 
55 

59 

,32 
02 



50 
52 



66 
18 



.64 

. 50 
.68 

. 77 
.61 

c *v 
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